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ABSTRACT 



Hardware now being developed for use in computer-based education 
can be thought of as the forerunner of a new generation of communications 
media. Since previous communications technologies have led to the 
development of new literary forms, it is reasonable to assume that 
computer-based conmunications media uill also adopt a unique way of 
structuring information. The forerunner of this new literary form 
may well be the Delphi Technique which has been developed as a fore- 
casting methodology. This paper outlines the use of "information 
units" as a flexible way of describing possible futures, presents 
data from early versions of an "exploration of the future" on the 
PLATO system at the University of Illinois, and discusses how this 
data might be thought of as examples of feedback messages in the two- 
way literary form of a computer-based communications mediiun. 



Several years ago Prof. Chorles E. Osgood suggested that it 
might be possible to develop a program for a computer-based 
education system which would eventually allow the public, possibly 
at a world's, fair, to "explore the future. Such an "exploration" 
would be useful both for education and for social science research. 
This paper is the fourth in a series of progress reports on the 
continuing development of that "exploration of alternative futures" 
using the PLATO system (see Figure 1). 

The educational function of the exploration is accomplished by 
exposing the "explorer" to four types of information: 

1. A list of developments possible in the future. 

2. The model of "reality interaction" used in the computer 
program. 

3. The decision-making procedure, including making investments 
to change probabilities. 

4. The operation of a teaching computer. 

With regard to research the responses of explorers provide 
useful social science data. The data from these exercises can 
reveal which developments people consider desirable, which developments 
they are most familiar with, and which developments they are most 
interested in. Data from several demonstrations of early versions 
of the exploration will be discussed later in this paper. 

In short this work originated neither as an attempt to develop 
software for a new communications medium nor from an interest in 
conducting on-line Delphi studies as a decision-making^aid. The 
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direction in which the research moved resulted in part from the 
nature of the medium and In part from our concern with increasing 
public participation in decision-making processes* 



THE EVOLUTION OF THE PROJECT / 

After the project had been underway for a year or two, it appeared 
that this work could have applications beyond simply education and 
social science research. This belief resulted from the projected 
growth of the PLATO system and the ease with which the computer 
program for the exploration could be modified to deal with problems 
other than the general future of mankind, 

A glance at the past 

The PLATO III system, which we have been using, is capable of 
operating 20 terminals simultaneously. However, the PLATO IV system, 
scheduled for completion in 1974 or 1975, is being designed to 
operate 4000 terminals simultaneously (see Figure 2). 

When the first wave of interest in computer-aided Instruction 
began in the early 1960*s there were basicall*' two questions which 
had to be answered. First, could students learn educational material 
as rapidly and retain it as well if they were taught using a 
computer terminal rather than by sitting in a classroom? Second, 
was computer-aided Instruction economically competitive with class- 
room instruction? After a decade of educational experiments at the 

University of Illinois and elsewhere, the answer to the first question 

2 

is emphatically yes. But computer-aided instruction is not 

economically competitive using the technology available in 1960. 

It was this realization ^ that the crucial problem lay in the cost 

of the equipment and its operation - that led to the invention at 

the University of Illinois of the plasma display panel and the 

3 

development of the PLATO IV system. 
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Figure 2. Using terminals such as the one pictured above, 
the PLATO IV system scheduled for completion In 1974, will 
provide a high quality color display at low cost. The 
terminals will be connected to the computer over standard 
voice-grade telephone lines. 



A computer-based education system which is both educationally 
effective and economically competitive will in all probability be 
adopted throughout the United States and around the world in due 
course. With the prospect of teaching computer terminals In most 
classrooms, if not most homes, within a few decades, we began to think 
of this equipment as a new kind of mass communications medium. 

Generations of communications media 

If radio and television are thought of as first and secozid 
generation mass communications systems, then perhaps the PLATO system 
could be thought of as a forerunner of a third generation mass com- 
munications system. Originally, we felt that built-in feedback 
would be the characteristic distinguishing computer-based communications 
systems from radio and television. 

However, due to the feedback posslbillfies of cable television, 
it now seems more appropriate to list four "generations" of electronic 
communications media now existing in at least prototype form. 

^* ^^^^Q transmits audio messages from the center to the 
periphery. 

2. Television transmits audio and visual messages from the 
center to the periphery. 

3. Cable television provides a great Increase in the number of 
available channels and the possibility of both passive 
feedback (monitoring what people watch) and active feedback 
(for example, voting by pressing a button on the television 
set). 

^» Computer-based communications systems have several new 
charac terls tics . 

a. Less simultaneity: Although many people may be using 
the same program, each may be In a different part of the 
program. Thus everyone on one ••channel** does not see 
the same thing at the same time. 

b. Less evanescence: With radio and television a listener 
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or viewer cannot go back if he misses a word or sentence 
(unless he has a tape recorder). With PLATO each 
individual progresses at his own rate« The display does 
not change until he wants it to, and he can go back to 
review previous displays, 
c. Viewer-designed programs: With PLATO the viewer can ask 
for additional information or can jump ahead if he 
becomes bored, thus to some extent designing his own 
program* 

For the sake of clarity it should be noted that the displays for 
computer-based communications systems are generally static, like 
color slides, rather than dynamic, like movies or television* Mes- 
sages are conveyed primarily by the use of words, frequently sup- 
plemented by tables or graphs and occasionally by drawings and pictures 
However, the PLATO IV equipment, as contrasted with the PLATO III 
equipment, will use audio as well as visual messages and will be 
better suited to simple moving displays such as dancing stick figures 
or plotting out a graph* 

Applying the exploration to specific issues 

Even before we began thinking of the PLATO system as a new kind 
of mass communications medium and not simply as a teaching device, 
we had thought of writing explorations on a variety of different 
topics such as disarmament, the future of education, and urban plan- 
ning* But with the probable widespread acceptance of computer-based 
education in the next few decades, it seemed that our work suggested 
the possibility of using this equipment as a medium between planners 
and the public for exchanging information and opinions regarding 
community goals. ^ 

The adaptability of the exploration resulted from the fact that 
the decision-making framework could remain the same for any problem 
area and that only the information units with the matrix giving the 
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relationships between them would need to be changed. 

Thus the projected expansion of the PLATO system and the ease 
with which the exploration could be modified to deal with specific 
issues resulted in our thinking of the teaching computer as a new 
kind of mass communications, medium particularly suited to discussions 
among different interest groups about the long range goals of a 
community. But how does one present, information on this new medium? 

HOW DOES ONE DESCRIBE THE FUTURE? ^ = 

Programming an exploration of the future required suggesting 
possible future developments in a waywhich emphasized their 
probabilistic nature and in a way which could b1e easily manipulated 
by the explorer. ^ We needed a method of presenting possible future 
developments so that people could request additional information, 
make "investments" which would alter the initial probabilities, and 
see the possible secondary effects of their actions. Consequently 
we assumed that the future, and also the present and the past, can 
be described using "information units". 

Features of information units 

The features or components of an "information unit", as described 
in an earlier report, were 1) a short descriptive statement, 2) a 
background para^^raph, and 3) an associated probability or other 
measure.^ It now seems necessary to expand and revise this list of 
featuries. 

The background information (2* can involve graphs, charts, 
pictures, drawings, and tape recordings in addition to written in- 
formation. 



Complete measurement (3) of an historical occurrence requires 
the measurement Itself, the date the measurement was made, and some 
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indication of measurement error. The measurement of a forecast 
requires the forecasted value of a parameter, the date at which that 
value of the parameter is expected to occur, some indication of 
certainty about the forecast, and also the dale at which the forecast 
is made. 

With respect to graphs of information u* , horizontal 

axis will always be time. The vertical axis ..a we have used so 
far for developments has been probability, ranging from 0 to 100 
percent. This kind of scale requires a specific, identifiable event 
such as 50 percent of the nation's s^-hools having computer-based 
education equipment or 50% of the population favoring the legalization 
of marihuana. A superior method of forecasting would lend itself 
more easily to validation and would make possible the measurement of 
progress toward a goal as the years pass by. Such a scale is sug- 
gested By the previous format. Rather than measuring the probability 
of a particular level of distribution of a technology, one can simply 
measure the distribution itself. Similarly one can estimate the 
percentage of the population which will favor a social development 
rather than the probability of a particular degree of acceptance. 
Regarding the development of a technological capability, as opposed 
to its diffusion once it is developed, one could list the stages of 
development ranging from the original concept through experimentation 
and prototype construction to the first production model. However, 
this kind of measure would use an ordinal rather than an interval 
scale. 

i\n important new feature which should be noted explicitly when 
developing lists of information units is the group or person suggesting 
a particular idea as important (4) and worthy of attention. This 
information can usually be deduced either from the name and affiliation 
ofHihe person writing the paper or from the list of people who took 
part in a Delphi exercise. The person or group originating an idea 



is frequently recorded* However, the thought behind recording this 
data is usually either to aid in locating additional background 
material or to give credit where it is due# But such information 
is also politically relevant. It is needed so that other forecasters, 
public officials, and especially the general public, will know whose 
ideas about the future of society are represented in the total set 
of forecasts and social indicators now being generated* People in 
different walks of life, in different socioeconomic groups, will be 
subjected to different stresses in their daily lives. Consequently 
they will define different "problems" as being important for mankind 
to solve. The intervention of politics into forecasting cannot be 
avoided^ we can only try to be aware of possible sources of bias so 
that the interests of all groups will be as fairly represented as 
possible.^ 

Categories of information units 

Information units can be divided into four categories: 

1. Developments > including both social and technological 
developments, refer to new characteristics of the social 
system. 

2. Initiatives are actions taken by a group or an individual. 

3. Events are sudden or unanticipated occurrences. 

4. System variables, now more commonly called social 
indicators, are measures of a system which fluctuate 
in time. 

Two criteria are used to distinguish among these four kinds of 
information units: the shape of the graph over time and the extent 
of human control. 



Type of 
information unit 
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Shape of graph 



Human control 



Development 

Initiative 

Event 

Social indicator 



S-curve 
Step function 
Spike function 
Fluctuation 



Many small decisions 
Single large decision 
Very little control 
Regular adjustments 



The earlier report suggested that the four categories of 
information units could be thought of either as "change-producing 
factors" (developments • events, and initiatives) or as "system 
variables" (social indicators). The distinction between these two 
larger categories lies in the period of time during v;hich the in- 
formation unit can usefully be of interest. System variables or 
social indicators are of interest over an indefinite period of time 
and so are used to monitor the behavior of social systems. Change- 
producing factors can occur in a period of hours or years but are of 
little interest outside of the period of time during which they are 
producing change in the social system. 

Most mathematical models deal with the relationships among 
several "system variables", such as population, per capita income, 
gross national product, and capit^^l investment in agriculture. 
Delphi studies usually concern themselves only with "change producing 
factors". An ideal exploration of the future would use both system 
variables and change-producing factors. 

A new literary form 

Every new communications medium seems to generate its own 
distinctive forms for structuring information. The printing press 
made possible newspapers, journals, and novels. Films greatly 
extended the use of animated cartoons and led to zoom and pan shots, 
parallel editing and special visual effects. Radio and television 
produced the talk show, 15 minute news, commercials, and spot 
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announcements • The mimeograph machine was best suited to the leaflet 
the working paper, and the "underground press". The xerox machine 
promoted letter v:r\ting to multiple recipients and extended the 
readership of journal and magazine articles. It is not surprising 
that computer-based communications media also seem to be developing 
their own literary form. 

Branching sequences and mathematical algorithms, so useful in 
"individualized instruction", create a demand for literature in 
which statements and paragraphs can be rearranged, dropped or added. 
Scripts or programs which follow the single logical "sequence of the 
essay are criticized by the managers of the medium as "not taking 
full advantage of the capabilities of this kind of system". In such 
cases there is pressure to either rewrite the material or present it 
using a different communications medium. 

Rather than an articulate text with an interest-arousing 
introduction and a good summarizing conclusion, the material written 
for a computer-based communications medium, particularly when it 
deals with public issues, emphasizes alternatives and their con- 
sequences and concisely stated, measurable events. With this medium 
a person can describe his ideal future without having to give a 
speech or wr: te an essay or book. Furthermore, his views can be 
easily compared or combined with the "ideal futures" of other people, 
thereby informing the explorer, the programmer, and the general publi 
what visions are dancing in the heads of their fellow citizens. 

We have long needed a literary style which, rather than imposing 
a particular idea, tends to draw out new ideas, and which tends 
simply by its form to make normally implicit assumptions explicit so 
that they can be challenged, \nien people see that they disagree 
about the relationships between developments or events they may 
discover that their disagreements are not about basic values or 
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goals as much as they are about factual questions such as what does 
in fact lead to what# 

The future-oriented literary form of the Delphi Method is dif- 
ferent in several important respects from the present and past-oriented 
literary forms more commonly used today The essay form, whether 
a newspaper report, a magazine article or a book, is most useful for 
develcoing a single idea to a certain degree of detail. A story 
related in this way has only one plot and all the subplots are 
related in the same way for all readers. Thus for the reader it is 
not a very personalized artistic form, no matter how weird one's 
powers of interpretation. It is little wonder that one criterion of 
quality in a short story or novel has been the range of interpretations 
or meanings which can be drawn out of it. This practice might be 
thought of as bestowing cuddos for the ability to transcend the 
limitations of the medium. Imagine the artistry possible if a 
literary form could be designed which had nearly all of the strong 
points of the essay but reduced or eliminated some of the limitations! 

The essay requires only the passive involvement of the reader. 
Fantasy and relationships with previous knowledge or experience can 
be brought into play, but the new ideas which are generated cannot 
be tested out in the story itself. Literary essays, reports, stories, 
even films, plays, and melodramas are closed ended and are character- 
ized by high certainty. Events do or do not happen. The closest 
thing to the hypothetical or probabilistic is the scientific report 
with its margins of error and the assumption that refutation is pos- 
sible* But the scientific report states facts, not possibilities. 
Even science fiction stories while beginning from a hypothetical 
situation follow a fixed course to a unique conclusion, 

Robert Theobald's Teg's 1994 a mimeographed, alterable account 
of a small girl's possible future world Is one example of rumblings 
of a demand for new literary forms which are flexible, probabilistic. 
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open-ended and user-controlled, thereby permitting active involvement 
g 

of the reader. A more conditional and manipulable style of 
literature will not be very satisfying and may be downright discon- 
certing to some people. It will probably be most satisfying for 
people who have a high tolerance for uncertainty and ambiguity and 
who appreciate being asked for their judgments as well as being 
given someone elses. A plot not subject to influence other than 
interpretation is suitable for a past not subject to influence other 
than interpretation. A future susceptible to action and open to 
invention requires a medium which invites action and encourages 
invention. 

THE EXPLORATION AND SOME RESULTS 

With the preceding background on how our thinking about the 
project has evolved and the refinement of what is meant by information 
units, we shall now pause in our speculations for a look at the 
presents version of the exploration and the data which has been col- 
lected so far. 

An outline of the exploration 

The decision-making procedures In one cycle of the 40 informa- 
tion unit exploration were as follows: 

1. From a list of the 35 social and technological developments 

programmed Into the computer the explorer chooses a development 

9 

whose probability he would like to change. The object is to make 
more probable those developments which the explorer considers 
desirable and less probable those developments which the explorer 
considers undesirable. However, desirable developments may have 
undesirable secondary effects, and undesirable developments may have 
some desirable secondary effects. 

2. The explorer makes an ••investment** (an Indication of 
desirability) between -100 and +100, where -100 would mean that the 
development Is maximally undesirable, 0 would mean that the development 
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is neither desirable nor undesirable , and +100 would mean that the 
development is maximally desirable. An investment such as +50 
would mean that the development is moderately desirable. In the 
present version^ no limit is placed on the total amount which can be 
invested in an exploration. 100 units could be invested during each 
cycle. 

3. The computer shows in table form the secondary effects of 
the explorer's Immediately preceding investment according to the 
estimates of secondary effects put into the computer by the program- 
mer. For each development listed as a secondary effect the computer 
displays the old probability (before the investment) and the new 
probability (after the investment) and the change in probability 
(the difference between the two). 



* For a discussion of the mathematical model used in the exploration 
and the decisions which have to be made by the programmer ^ see 
reference 5. . - 



4. An oracle message is displayed. Oracle is a verbal message 
telling which developments are likely to happen In the year 2000 and 
which are not likely to happen, on the basis of the current probability 
of each development In the exploration. 

5. At the end of each cycle the computer performs several 
random calculations to determine whether an "event" occurs. If an 
event does occur, a background paragraph about It Is presented and 
then Its effects on the probabilities of the social and technological 
developments are shown by a table of secondary effects. 

Tradeoffs due to hardware and software limitations 

The primary limitation on the complexity of these explorations 
has been the amount of computer memory allocated to what Is called 
student bank, the number of words accessed by only one terminal. 
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The number of variables can be increased somewhat by packing, but of 
course this procedure involves a limit as well. 

The 15 information unit explorations^ particularly the later 
oneSy involved a larger number of decision-making operations in each 
cycle, such as indirect investment (what other developments are likely 
to affect the occurrence of the development under consideration) and 
asking for estimates by the explorer of some of the probable 
secondary effects of the development being considered. 

When the number of information units was expanded to 40, the 
number of decision-making operations performed by an explorer in 
each cycle was decreased. This reduction resulted both from the 
demand for more variables caused by more information units and from 
the addition of some more sophisticated computer operations. 

Discussion of the data 

Since work on developing the computer program began in the fall 
of 1966, sixteen demonstrations of an exploration of the future have 
been given during which data was recorded. Numerous demonstrations 
were given during which data was not collected. Table I lists by 
dates the demonstrations during which data was collected. The number 
of people participating in the demonstration and the background of 
the group are given in the second and third column. The rigjht hand 
column contains notes about the nature of the program, such as the 
number and categories of information units and the decision-making 
operations which were added or dropped since the previous demon- 
stration. 

The first 11 demonstrations were of an exploration having only 
15 information units, all of which were either social or technological 
developments. Demonstrations 12-16 were of an exploration having 
40 information units — 35 social and technological developments and 5 
events* Table II lists the 35 social and technological developments 
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TABLE I 



DEMONSTRATIONS WITH RECORDED DATA 



1. 
3* 




3/13/68 

Slum 



4* 7/10/68 



5* 10/9/68 



6. 
7- 



2/1/69 
2/17/69 



8* 3/3/69 

9* 3/4/69 
10* 3/17/69 



Number of 
people 



17 



10 



11 



6 

7 



15 

9 

7 



Group 



Social 
Science 

Under gradua tes 



Social 
Science 
Faculty & 
Graduate 
Students 
Undergraduates 
from several 
disciplines 



1* 
2. 



1. 
1. 
3. 

6. 



8, 

lo; 
1. 

2. 

1. 
1. 
3. 



local press 

Undergraduates 

from several 

disciplines 

Political ] 

Science 

Graduate 

Students 

Social 

Science 

Undergraduates 
Political 
Scien ce 

Graduate Students 



Notes 

15 information units 

uses GENERAL language 

only comment data 

(Always same as preceding 

demonstration except a« noted; 

uses-TUTO I language 

no comment mode 

primary development (PD) selected 
randomly a:%d ncc recorded in data 
shows background paragraph for PD 
investment is only +, 0, - 
asks for relationship of PD to 4 
predetermined secondary developments, 
relationship must be given as +,0,- 
select 5 to follow, option to see 

3 other secondary effects 

4 stage oracle 

main calculation sequence is part 
of special version of TUTOR 
secondary effects matrix read in 
by paper tape (-f, 0, -) 
magnitude on investment can go 
to + 99 

-asks for numbers of 3 developments 
vhich mi£iit: affect PD and how they 
will affect PD (+, 
indirect investment possible in up 
to 5 developments 
no question on what developments 
affect PD 

magnitude of investment can go to 
total of 100 in one cycle 



Built-in comment mode 



17 



TABLE I (Contd.) 



Date 



11. 5/12/69 



Number of 
people 

13 



12. 2/14/71 



13/ 2/20/71 

14* 2/27/71 

15* 2/28/71 

16. 3/6/71 



5 
8 
13 
6 



Group 

Education 
Professors 



Landscape 
Architecture 
Graduate 
Students 



WBBM reporter 
and friends 
Urban planning ^ 
Graduate Students 
Graduate Students 
In secondary education 
Graduate students 
In religion 



Notes 

1. data printout at end of each cycle, 
gives PD, cycle number, and 
probabilities for all 15 develop- 
ments 

2# calculation sequence and secondary 
effects matrix built into Delphi 
program 

1. 40 information units, 35 develop- 
ments and 5 events 

2. PD selected by explorer 

3. background paragraph for PD not 
automatically displayed, must be 
requested 

4. no Indirect investment 

5. does not ask for estimates of 4 
secondary effects relationships 

6. automatic selection of secondary 
effects, only those whose probabili- 
ties are changed by the investment 
In'PD 

7. secondary effects matrix with 
relationships up to + 3 
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according to the mean investment in each development • 

Table III lists the developments in order accord. ng to the 
number of times each development was chosen as an object of investment. 
The greater the number of people who choose to invest in a development, 
the less influence each person has in determining its mean investment. 

The number of times that background infomation was requested 
for each development is shown in Table IV. There are no doubt a 
variety of reasons for requesting background information. The more 
prominent items in the list seem to be those with which people are 
least familiar. Background paragraphs are also frequently requested 
on subjects which the explorer is familiar with, probably in order 
to test the expertise of the people writing the program. Similarly, 
controversial subjects seem to be called up in order to divine the 
political opinions of the programmer. 

Ten minutes before the end of the hour each person is asked to 
type a code word in order to jump to a series of questions at the end 
of the exploration. Seven of these questions are listed in Table V. 
Question 2 asks, "If you had it to do all over again, would you change 
any of your investments?" If the explorer answers, "yes", he is 
then asked to list the numbers of the developments in which he would 
make a different investment. Table VI lists the 35 developments in 
order from the most to the least frequently mentioned in responses 
to this question* 

Not all of the people who worked through at least part of the 
exploration completed the questionnaire at the end of the exploration. 
Fifty-four people participated in 6 demonstrations* Of that 54, 39 
completed the questionnaire* 

A non-random sample of people 

It should be stressed that the people who took part in these 
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TABLE II 

RANK ORDER OF DEVELOPMENTS 
BY MEAN INVESTMENT* 



Development 



1. Pollution Control 

2. Racial Barriers Eliminated 

3. Abortion Legalized 

4. Population Planning 

5. World University 

6. World Currency 

?• Treaty Banning CBW R&D 

&• Complete Nuclear Disarmament 

9* World Aid Program 

10. Ocean Farming 

11. Synthetic Food 

12. Staggered Work Week 

13. Group Marriage Legalized 

14. International GNP Tax 

15. Marijuana Legalized 

16. Citizen Sampling Simulations 

17. "Sexicare" 

18. Time Travel by Deepfreezing 

19. Global 3-D Color TV 

20. Air Cushion Vehicles 

21. Manned Lunar Base 

22. Weather Modification 

23. Animal Donors 

24. National Data Bank 

25. Nationless Corporations 

26. Credit Card Economy 

27. Teaching Computers 

28. Legal Decisions by Computers 

29. Passing of Religion 

30. Intelligence Drugs 

31. Genetic Manipulation 

32. U. S. in Limited War 

33. Continued Urbanization 

34. Cloning of Humans 

35. All-out Nuclear War 



*Data from demonstrations 12-16 
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TABLE III 

RANK ORDER BY FREQUENCY WITH WHICH THE DEVELOPMENT 
WAS SELECTED FOR CONSIDERATION* 



Number of times Chosen 
Development for Investment 



1. 


Pollution Control 


31 


2. 


Racial Barriers Eliminated 


25 


3. 


Complete Nuclear Disarmament 


23 


4« 


Abortion Legalized 


21 


5. 


All-out Nuclear War 


19 


6. 


Population Planning 


18 


7. 


Continued Urbanization 


15 


8. 


Genetic Manipulation 


15 


9. 


Citizen Sampling Simulations 


13 


10. 


Cloning of Humans 


13 


11. 


Group Marriage Legalized 


13 


12. 


International GNP Tax 


13 


13. 


Treaty Banning CBW R & D 


12 


14. 


World Aid Program 


12 


15. 


World University 


12 


16. 


Marijuana Legalized 


11 


17. 


Passing of Religion 


11 


18. 


U. S. in Limited War 


- 11 


19. 


Air Cushion Vehicles 


10 


20. 


Credit Card Economy. 


10 


21. 


Legal Decisions by Computers 


10 


22. 


Manned Lunar Base 


10 


23. 


"Sexicare" 


10 


24. 


Intelligence Drugs 


9 


25. 


National Data Bank 


9 


26. 


Animal Donors 


8 


27. 


Ocean Farming 


8 


28. 


Synthetic Food 


8 


29. 


Global 3-D Color TV 


7 


30. 


Staggered Work Week 


7 


31. 


Weather Modification 


7 


32. 


Nationless Corporations 


6 


33. 


Teaching Computers 


6 


34. 


World Currency 


4 


35. 


Time Travel by Deepfreezing 


3 



* Data from demonstrations 12-16 , a total of 41 people 
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TABLE IV 

RANK ORDER BY FREQUENCY WITH V-HICH BACKGROUND INFORMATION 

WAS REQUESTED* 

Number of times background 
Development information was requested 

1. Cloning of Humans 22 

2. "Sexicare" 21 

3. Citizen Sampling Simulations 17 

4. Pollution Control 15 

5. Racial Barriers Eliminated 15 

6. Treaty Banning CBW R&D 15 
\ Complete Nuclear Disarmament 14 

8. Group Marriage Legalized 14 

9. Passing of Religion 14 

10. - Population Planning 14 

11. Abortion Legalized 13 

12. Animal Donors 13 

13. Genetic Manipulation 11 . . 

14. All-out Nuclear War 10 

15. Air Cushion Vehicles 9 

16. Continued Urbanization 9 

17. International GNP Tax 9 

18. Ocean Farming .8 

19. World University 8 

20. Intelligence Drugs 7 

21. Legal Decisions by Computer 7 

22. National Data Bank j 

23. Staggered Work Week 7 

24 . Nationless Corporations 6 

25. U. S. in Limited War 6 

26. World Aid Program 6 

27. Marijuana Legalized 5 

28. Synthetic Food 5 

29. Credit Card Economy 4 

30. Manned Lunar Base 3 

31. Teaching Computers 3 

32. Time Travel by Deepfreezing 3 

33. Global 3-D Color TV 2 

34. World Currency 2 

35. Weather Modification 1 



Data from demonstrations 12-16 
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TABLE V 

ANSWERS TO QUESTIONNAIRE AT 
END OF EXPLORATION* 



!• Is the outcome close to or far away from the future you had hoped 
to achieve? 



a* very close 

b* close 

c# slightly close 

d. slightly far 

e. far 

f. very far 



2 
14 
19 
2 
1 
1 



2. If you had it to do all over again, would you change any of your 
investments? 



a. yes 

b. no 



25 
15 



3» I found the information in the background paragraphs 



a* helpful 

b. not helpful 

c • wrong 



33 
4 
2 



4. I found the instructions on what to do next 



a# sufficient 

b. insufficient 

c. repetitious 

d. badly writteri 



34 
2 
1 
2 



5# All in all I found the Delphi exploration to be 

a# loads of fun 10 

b* fun 25 

c» e bore 0 

d. a complete waste of time 1 

6* Sex 



a* F 
b* M 



12 
24 



* Data from demonstrations 12 to 16 
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TABLE V (Contd.) 



7. Year in school 



I a* freshman 2 

b. sophomore 2 

c, junior 0 
r d. senior 4 



e. graduate student 20 
f • professor 15 



TABLE VI 

DEVELOPMENTS IN \^ICH PEOPLE TOULD 
HAVE CHANGED THEIR INVESTMENT* 



Development Number of 

1* Continued Urbanization 

1. Pollution Control 

3* U* S. in Limited War 

4. Complete Nuclear Disarmament 

5. Legal Decisions by Computers 

6. Ocean Farming 

7# Passing of Religion 

8# Population Planning 

9. Racial Barriers Eliminated 

10* Treaty Banning CBW R&D 

11# World Aid Program 

12 « Cloning of Humans 

13. International GNP Tax 

14. National Data Bank 

15. S3mthetic Food 

16. World Currency 

17. Abortion L igalized ^ 

18. All-out Nuclear War 

19. Genetic Manipulation 

20. Group Marriage Legalized 

21. Intelligence Drugs 

22. Nationless Corporations 

23. "Sexicare" 

24. Staggered Work Week 

25. Teaching Computers 

26. Weather Modification 

27. Air Cushion Vehicles 

28. Animal Donors 

29. Citizen Sampling Simulations 

30. Credit Card Economy 

31. Global 3-D Color TV 

32. Manned Lunar Base 

33. Marijuana Legalized 

34. Time Travel by Deepfreezing 

35. World University 



* Data from demonstrations 12-16 



25 

demonstrations were not randomly selected from the population at 
large. They were not even randomly selected from the university 
community. The disciplines represented are suggested by the groups 
listed in Table I. The data in Table V, questions 6 and 7, shows 
the distribution of people according to sex and year in school. An 
open-ended question on political viewpoint stimulated frequently 
extended criti'^ues of American society. My own interpretation of 
their answers indicates that there were two radical liberals, 10 
liberals, and 2 people between middle and right wing. 

Furthermore, the people were not randomly selected in terms of 
their interest in the exploration. With the exception of a few 
students in political science classes, all of the explorers to date 
have asked to work through the exploration or have responded to the 
encouragement of a friend to do so. The most frequent pattern is fo>- 
an interested faculty member to bring along either a group of faculty 
members or a class of graduate students. We have not yet systematically 
sought representative samples since we are still primarily concerned 
with the development of a more interesting program from the view- 
points of both education and research. Consequently this data is 
presented only as a very preliminary indication of the kinds of 
responses that can be obtained when using a computer-based communica- 
tions medium to discuss an area of public policy. The responses 
should not be interpreted as representative of how the American 
people or even university people would rate the desirability of the 
developments listed. The data i£ useful in indicating how many pos- 
sible future developments can be considered by an educated person in 
a given period of time. 

Measures of performance 

Despite extensive instructions at the beginning of the exploration, 
a few people have great difficulty figuring out what they are sup- 
posed to do. This is shown by the fact that in Figure 3 several 
people were able to complete only a very few cycles. 
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The time allotted for the exploration was in most cases one 
hour* The demonstration on 2/20/71 extended to about an hour and 
twenty minutes. For the five demonstrations of the 40 information 
unit game the mean number of cycles completed was 10.3. For the 
four demonstrations in which only one hour was available, a mean of 
8.9 cycles were completed with the mode being 8 and the median 10. 

the number of people requesting a particular number of back- 
ground paragraphs is shown in Figure 4. The mean number of back- 
ground paragraphs requested was 8.8. The mode was 6 and the median 
11.5. 

The number of people having a particular number of random events 
occur in their exploration is given in Figure 5. The mean number of 
events in an exploration was 1.7. The mode was 1 and the median 2.5. 

Figure 6 shows the number of people who made a certain number 
of comments. The mean number of comments was 1.6. The mode was 1 
and the median 2. Everyone was explicitly asked for comments, sug- 
gestions, and criticisms as one part of the questionnaire at the 
end of the exploration. Consequently there were very few people who 
made no comments, or a response such as "none" in ansv;er to that 
question. Those people who made only one comment did so in reply to 
the specific request and did not interrupt the exploration in order 
to go into the "comment mode". 

Comments by explorers 

The comments made by the participants during the demonstrations 
reflected a variety of criticisms, suggestions, questions, and 
general reactions. Inese can be grouped in the following categories. 

1* Technical errors . Debugging is an activity familiar to all 
computer programmers. Debugging a program on a teaching computer 
involves calling in some friends who either have a knack for making 
things go wrong or who find a malicious glee in outwitting a computer. 
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FIGURE /♦ 

TOTAL NUMBER OF BACKGROUND PARAGRAPHS REQUESTED* 
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FIGURE 5 

TOTAL iJUMBER OF EVENTS IffllCH OCCURRED* 
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FIGURE 6 
TOTAL NUMBER OF COMMENTS MADE* 
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Examples of technical errors would be that the computer does not 
accept- a negative number when it should, or it accepts a letter when 
it should accept only numbers^ A few participants were quick to 
point out such errors: "Hal You made a mistake." 

2* Instructions . Nearly every exploration produces suggestions 
for clarifying the instructions. For example, "I did not understand 
how to invest and make a meaningful^ contribution toward my goal." 
"It would be helpful if we were given a reminder to enter our choices 
and outcomes on the data sheet." "Need more explanation of what you 
mean by investment." 

3. The purpose of the exploration . In a game in which no score 
is kept, where the object is to make the desirable probable and the 
undesirable improbable, expressions of confusion are to be expected. 
"The final results of the game or the goals were not clear to me." 
Some people seem to have difficulty conceptualizing complex systems. 
"I had difficulty realizing the issues. Consequently, I*m not sure 

I was making intelligent decisions." On the other hand, some people 
experience "an awakening of the sense of the future of man." 

4. Important items not included . Some of the most thoughtful 
and helpful comments deal with what is not included in the exploration. 
"I did not think that there were enough policy factors involved in 

the issues contained here. For example I would have liked to see 
the question of manipulation of the individual considered more 
explicitly — in other words questions about attitudJrtal changes." 
"Complete disarmament rather than nuclear disarmament should be one 
of the futures included." 

5. The original probabilities . Explorers sometimes question 

the actual estimates. "All out nuclear war is not possible." And some- 
times they question who made the estimates. "I am curious as to how 
the original probabilities for the given issues were determined." 

6. Background paragraphs . The brief background information 
was challenged usually for not giving sufficient attention to con- 
sequences, regulation, or alternative solutions. "Nothing was 
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mentioned about the effects of pressure on the surface the air 
cushion vehicle is going to be passing over# Until the ecological 
effects of such an apparatus over a natural surface are determined, 
I would seriously question such an apparatus." "In such items as 
cloning of humans, crucial matters would be the regulations that go 
along with the process. It is difficult to decide if it is good or 
bad without at the same time fixing some of the regulations." 
"Legislation or executive action is not needed to stabilize population 
growth rate — education is the answer to this problem." 

7. Secondary effects . Questions about secondary effects ranged 
from who determined them and the logic used, to amazement that there 
were so many. For example, "How does a 100% investment in world aid 
program reduce probabilities of ocean farming and synthetic food?" 

"I am unclear as to how the associations were decided upon after I 
had made my investment or an event had happened. Some of them did 
not make sense to me. Like some of the considerations were left out." 
"I do not see what happened at this point which caused the probability 
of limited war to increase." "I would have been interested in how 
various choices affected other events specifically, e.g. a little 
more about why one probability caused a particular change in another 
variable." "Frightening how one decision influences so many others 
you never took into consideration when making your initial decision. 
On some do not see off hand how the influence came about." 

8. Ifliat makes the exploration enjoyable . "I like when you add 
the event to make it more exciting." "I was angry at being told 
what to do in such a demanding way by a machine. My hands felt 
slapped each time I made a mistake." "I would have liked to have 
finished in order to see the full picture of the world. Occasionally 
became bored, however, perhaps due to each step being handled in the 
exact same manner as the previous." 

9. The dangers or opportunities implied by this technology. 
Only a very few people remarked on the potential of this kind of 
equipment and this kind of program for radically altering the process 
of citizen participation in planning. The people who do comment on 
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this possibility have usually been students who were told in advance 
what this work might lead to. More than v;e would like, people have 
concentrated on the information in the program rather than thought 
about the possibilities of this kind of information exchange. 
^'Concerning this computer, I hope we never go into teaching children 
by this means even though I can see where it may be more efficient. 
Learning how to deal with people seems much more important to me." 
"The greatest difficulty here is that as well explained as the process 
is, it is still very confusing. I am not sure you could ever get 
the general public to use them as the general public strikes me as 
being ver>' lazy and therefore would hot consider this worth the ef- 
fort." "I think the Idea is very interesting and has many possible 
applications especially in finding out what the coiranon level of 
awareness is and where work is needed to bring what area up." "A 
great start at showing the inter-relationship of various particular 
choices." 

FURTHER NOTES ON SOCIAL IMPLICATIONS 

Not all of the analysis which can be performed on the data from 
these demonstrations has yet been carried out. But perhaps the 
preceding discussion is adequate evidence that the earlier and fol- 
lowing speculations and philosophical musings are based on experiences 
with operational though still elementary prototypes. 



An earlier consideration of possible social, political, and 
psychological implications of citizen participation in planning using 
computer-based coiranunications media is contained in reference 4. 



The practicality of public discussions 

The data presented here is useful in estimating the feasibility 
of widespread use of "citizen sampling simulations" to involve the 
public In the planning process. It is to be expected that some people 
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will be intimidated by the thought of using a computer and will be 
overwhelmed by this advanced communications technology. As was 
mentioned earlier, there is some evidence that a few people do have 
great difficulty with the program or at least proceed very slowly. 
Nevertheless, learning how to use a new technology and also exploring 
a list of 35 unusual social and technological developments is a 
demanding task for a one hour period. The success of these people 
in performing that task leads us to believe that community issues 
can be discussed by the public with this kind of technology, particularly 
as people gain practice in using it.^^ 

The power of suggestion 

The method of describing the future using information units 
seems to have been successful. Most people find the experience 
educational, and the basic structure of the program — the way the 
future is described— has not been criticized by most people who play 
the game. However, a few perceptive observers have expressed 
skepticism about the exploration, and rightly so. Simply listing a 
set of possible developments structures the thinking of explorers 
and thereby severely limits the range of responses. This is confirmed 
by the fact that people rarely suggest new developments or criticize 
the list given. 

Those observers who are equally concerned but less theoretically 
inclined question the assumptions about the world which led to the 
selection of that particular set of forty information units. Further- 
more there is a danger that some individuals may assume the changes 
in probabilities are "real" or indicate something more than merely 
the aggregated judgment of a group of individuals. 

In future explorations we intend to make even more explicit the 
fact that the original probabilities and the changes in probabilities 
of other developments which we call "secondary effects" merely reflect 
the judgment of the programmer and the people he has consulted and 
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that the consequences indicated are not determined by a computer 
model based upon verified theories of the operation of social systems. 

A program now being developed on ^ specific problem area, the 
Future of the University, uses probability, desirability, and impor- 
tance ratings and both occurrence and non-occurrence matrices for 
three separate groups — t-tudents, faculty members, and administrators. 
In this program the computer is serving as a communications medium 
between the programmer and the people at the terminals. In the 
Future of the University program the fact that the computer is simply 
operating as a mediator among groups of people with different pat- 
terns of concern and perceptions of the world is made much more ex- 
plicit. 

Who is communicating with whom? 

Even though the responses of each individual are not automatical- 
ly seen by the other participants and the program itself may be 
changed only at intervals involving weeks or months, communication 
can still be taking place. In order to clarify the differences among 
Delphi-like computer programs it is useful to keep in mind whether 
individuals or groups are communicating with each other, the number 
of times a single individual will sit down at a computer terminal 
in order to work on one particular problem, and how much monitoring 
or editing of responses is done by the programming staff. 

1. In Turoff 's Delphi Conferencing, as I understand it, the 
responses of each individual are seen by all the other participants 
in the exercise. Items are added or dropped on the basis of a vote 
taken among participants. No monitoring or editing of the exercise 
is done by anyone" except the participants themselves. Each time a 
person responds to a question or types a statement his responst 
not only recorded for viewing by the programmer but actually alters 
the program which each participant will view thereafter. Each 'i 
works on the given problem for a few minutes every day for sever \. 
days. 
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TABLE VII 
GROUP COIMJNICATION TECHNIQUES 





Delphi 


Citizen Sampling 


C ompu t e r-b as e d 




Conference 


Simulation 


Mediator 


Participants 


individuals 


planning group 


interest groups 






and the public 


2 or more 


Length of 


minutes 


1 to 2 hours 


1 to 2 hours 


Interaction 








Number of 


several. 


usually only 


usually only 


Interactions 


usually 1 


one 


one 




per day 






Normal 


usually 


at present 


at present 


Mode 


group 


completely 


only list of 




control and 


monitored 


items not 




no monitor 




modifiable 
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2. The idea behind the Delphi Exploration, which can be thought 
of as a prototype ^'citizen sampling simulation," was to have com- 
munication take place not among individuals but rather between the 
planning group and the public. The responses of the explorers are 
recorded and viewed by the monitoring group but do not automatically 
change the program itself. This pattern is similar to the normal 
process of instruction where communication takes place primarily 
between the teacher and the students. Each explorer works on a 
particular problem probably only once, at a sitting lasting from one 
to two hours. If the issue is a recurring one, the program is 
changed only every few weeks or months when the programming staff has 
an opportunity to reconsider the issue and to change the program on 
the basis of the responses obtained since the last modification of 
the program. The purpose of this kind of exercise is not to generate 
a forecast or a set of policy alternatives but rather to reduce the 
amount of time spent by planners in presenting background information 
to interested citizens and to generate data from the public on the 
desirability of particular alternatives, the completeness of the set 
of alternatives considered, and the way in which "the problem" is 
defined. 

3. For a "computer-based mediator," such as the program on the 
Future of the University, communication takes place neither among 
individuals nor between planners and the public with the planners 
also acting as monitors, but rather between conflicting interest 
groups with either no monitor or a neutral party acting as monitor/ 
arbitrator. The responses of individuals are not seen by the other 
participants except in the mean responses of a group. The position 
of each group is not arrived at by negotiation or compromise within 
the group but rather results from averaging the views of individuals 
in the group. In the present program the responses of an individual 
alter his group's estimates of probabilities, desirabilities, and 
causal relationships, but the list of information units can only be 
changed by the programmer. 
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The practice in Delphi Conferencing of allowing the participants - 
themselves to add and drop information units is a very important 
capability which can be incorporated into both citizen sampling 
simulations and computer-based mediators. 

Exchanging views vs. simulating complex systems 

There is a tendency to confuse this project with the presently 
growing number of attempts to model complex social systems. If that 
were our purpose, we would be greatly hampered by the technology we 
are using. The PLATO system was designed to operate a large number 
of computer terminals simultaneously with each terminal being al- , 
located a small amount of computer memory space. Our efforts are 
sufficiently similar to the modeling of complex systems that we have 
attempted to keep up with developments in that area in hopes that the 
form of the models would be applicable to our programs. 

However, given the limitr**ions of our equipment for doing that 
kind of work and given its uniqueness for doing the task for which 
it was designed, we believe that it would be most productive to spend 
our time developing the computer as a communications medium between 
people and as a device for helping less skilled people to articulate 
their mental models of how the world works. Since computer models of 
social systems inevitably embody the assumptions of the programmer 
about what the important variables are, the ability of less technically 
skilled groups to express their assumptions about important variables 
could be helpful in trying to achieve a balance of political influence. 
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